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The inclusion of the factor ln(l/JV!) in the thermodynamic entropy proposed by Gibbs is shown to 
be equivalent to the validity of the fluctuation theorem with absolute irreversibility for gas mixing. 


As analyzed by van Kampen |lj, what is collectively 
called the Gibbs paradox actually involves the following 
three distinct issues (see Fig. [I]): 

GP-I: consistency within thermodynamics m, 

GP-II: consistency within classical statistical mechanics 

ID SI, 

GP-III: consistency between thermodynamics and classi¬ 
cal statistical mechanics mmm- 

As detailed below, all of them have been settled in the 
thermodynamic limit HH51- However, in view of the 
growing interest in small thermodynamic systems |BHS|, 
it is worth revisiting the Gibbs paradox in this context. 
The conventional resolutions for GP-I [I] [3] and GP-II [T] 
apply to small thermodynamic systems as well. However, 
the one for GP-III cannot be applied to small thermody¬ 
namic systems j3]. 

The essence of GP-III is to determine ambiguity func¬ 
tion f(N) which gives the difference between the ther¬ 
modynamic entropy S and the statistical-mechanical en¬ 
tropy S' 3 *’ 11 as 

S(T, V, N) = S stat (T, V, N ) + k B f{N). (1) 

In the thermodynamic limit, extensivity of the thermo¬ 
dynamic entropy leads to f(N) = —NlnN+cN, where c 
is a constant GW However, extensivity breaks down in 
small thermodynamic systems. In this Letter, we show 
that in small thermodynamic systems the fluctuation the¬ 
orem 0 El EQHIZl with absolute irreversibility il8j in 
place of extensivity leads to f(N) = ln(l/lV!) + cN. 

A brief history. In the 1870s, Gibbs put forth the prob¬ 
lem of GP-I [21 pp.227-229]. Whereas identical-gas mix- 
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FIG. 1. Three aspects of the Gibbs paradox. GP-I, GP-II 
and GP-III respectively concern the consistency within ther¬ 
modynamics, the consistency within classical statistical me¬ 
chanics, and the consistency between thermodynamics and 
classical statistical mechanics. 


ing at the same temperature and pressure does not pro¬ 
duce an extensive amount of entropy, different-gas mixing 
does. The fact that the latter entropy production stays 
constant even when the difference between two species 
becomes infinitesimal seems paradoxical. Gibbs ascribe 
this to how we define thermodynamic states. This idea 
was further elaborated later. For example, van Kampen 
[H Sec.2-4] argued that the Clausius equality defines only 
the defference in entropy of a system where the particle 
number N is conserved. Therefore, to determine the N- 
dependence, we have to introduce a reversible process in 
which N is varied. For identical gases, opening a chan¬ 
nel between the two partitions is reversible. For differ¬ 
ent gases, this process is irreversible and consequently 
we have to invoke the familiar reversible procedure with 
semi-permeable walls. In this way, difference between 
identical- and different-gas mixings reduces the two dif¬ 
ferent processes used to extend the definition of entropy. 
Which of the two processes we should use depends on 
whether we intend to use the semi-permeable walls or 
on how we operationally define the identical thermody¬ 
namic states. “Thus, whether such a process is reversible 
or not depends on how discriminating the observer is. 
The expression for the entropy [...] depends on whether 
or not he is able and willing to distinguish between the 
molecules A and B” [I] pp.306-307]. As Jaynes put it 
[H Sec.5], the thermodynamic entropy has “anthropo¬ 
morphic” nature in that its value depends on “human 
information.” 

About a quarter century later, Gibbs discussed GP- 
III in his renowned textbook O Chap.XV] by introduc¬ 
ing two types of phase spaces, “the generic phase” and 
“the specific phase.” In “the generic phase,” a set of 
points in phase space are identified when any point in 
the set can be obtained by permutation of particles of 
other points, whereas in “the specific phase,” they are 
not. Gibbs preferred “the generic phase” to “the specific 
phase” because the former results in no entropy produc¬ 
tion upon identical-gas mixing [5] pp.206-207]. Thus, 
Gibbs introduced the factor ln(l/IV!) in classical sta¬ 
tistical mechanics to ensure the consistency with ther¬ 
modynamic observation. Van Kampen jlj, Sec. 9] later 
claimed that this prescription is guaranteed by conven¬ 
tion (namely, by assuming f(N ) = 0 in Eq. ([lj for 
the classical statistical-mechanical entropy in the generic 
phase). However, Jaynes [31 Sec.9] was able to determine 



2 


/(TV) from the extensivity of the thermodynamic entropy 
as we see later. 

In the 1910s and 1920s, the inclusion of the factor 
ln(l/TV!) was discussed within statistical mechanics (GP- 
II). In particular, Eherenfest and Trkal considered the as¬ 
sociation and dissociation of molecules from a viewpoint 
of atomic phase space |4], and concluded that the factor 
ln(l/TV!) is needed in calculating the chemical potential 
to guarantee the consistency within classical statistical 
mechanics. Later, van Kampen [1] Sec.7] derived the 
same factor based on combinatorics by considering a sys¬ 
tem connected to an infinitely large particle reservoir. 

Although the Gibbs paradox can be understood within 
classical theory as described above, Planck subsequently 
connected it with quantum distinguishability (e.g. see 
Ref. pH). Since then, the view that quantum theory 
resolves the Gibbs paradox has prevailed among physi¬ 
cists; for example, Schrodinger stated, “The modern view 
[i.e. quantum theory] solves this paradox by declaring 
that in the second case [i.e. identical-gas mixing] there 
is no real diffusion, because exchange between like parti¬ 
cles is not a real event [...]” [20] pp.61]. Now, in many 
standard textbooks (for example, see Refs. [2IH1S])) the 
factor ln(l/TV!) is attributed to the quantum indistin- 
guishability of identical particles. However, as van Kam¬ 
pen [T and Jaynes [3j pointed out, the quantum res¬ 
olution is in fact irrelevant to the Gibbs paradox. In 
fact, the quantum resolution suffers two major difficul¬ 
ties mm- First, it cannot apply to classical mesoscopic 
systems such as a colloidal system. Colloidal particles 
are not quantum-mechanically identical due to their dis¬ 
tinguishable internal degrees of freedom. Therefore, the 
quantum resolution fails to explain the factor ln(l/TV!), 
although it is needed to explain experimental results (e.g. 
see Refs. EH HE]). More importantly, quantum statisti¬ 
cal mechanics is at the same position as classical me¬ 
chanics with respect to Eq. ([l]). In other words, the 
quantum statistical-mechanical entropy S lq “ stat satisfies 
S = 5"i- stat + / q (TV). Therefore, we must go through 
with the procedure to determine the ambiguity function 
/ q (TV) as we do in the classical case. To refer to this 
fact, van Kampen PJ pp.311] catchily states, “the Gibbs 
paradox is no different in quantum mechanics, it is only 
less manifest.” 

Conventional resolution to GP-III. GP-III concerns 
the relation between the thermodynamic entropy S and 
the classical statistical-mechanical entropy ,S stat . While 
the latter is defined as the Gibbs entropy, namely the 
Shannon entropy of the canonical state, the former is de¬ 
fined through the Clausius equality as AS = J SQ/T, 
where 5Q is the heat transferred from the heat reservoir 
with temperature T to the system and the integration 
is taken along a quasi-static process. We note that the 
particle number TV cannot be varied in this process; if we 
start with open systems, the Clausius definition should 
be modified j5] Sec.9] (see Discussions for detail). There¬ 


fore, the thermodynamic entropy defined by the Clausius 
equality has ambiguity about TV. Consequently, the rela¬ 
tion between the thermodynamic entropy and statistical- 
mechanical entropy should involve some ambiguity func¬ 
tion /(TV) as in Eq. |l]) PJ Eq. (14)] 3J Eq. (16)]. The 
theme of GP-III is to demonstrate /(TV) = ln(l/TV!) (up 
to a constant per particle) for the classical statistical- 
mechanical entropy in the specific phase (or equivalently 
/(TV) = 0 for the one in the generic phase). Inciden¬ 
tally, we note that “exactly the same argument will apply 
in quantum statistical mechanics” El Sec.9]. Therefore, 
GP-III is not the issue of classical statistical mechanics 
in particular, but any statistical mechanics in general. 

Jaynes [3] Sec.9] resolved this issue for free particles 
by analogy with the way by which Pauli phenomeno¬ 
logically determined the TV-dependence of the thermo¬ 
dynamic entropy i[9J pp.38-39]. By requiring that the 
thermodynamic entropy satisfy extensivity 

S(T, qV : qN) = qS(T , V, TV), y q > 0, (2) 

and by invoking the formula of the statistical- 
mechanical entropy for an ideal gas S' stat (T. V. TV) = 
TVfce((3/2) InT + lnV + const.), one can show 

/(TV)=TV/(l)-TVlnTV. (3) 

Here, the first term on the right-hand side of Eq. ([3]) rep¬ 
resents an intrinsic entropy per particle, while the second 
term amounts to the factor — In TV! in the large-TV limit. 
Thus, the requirement of extensivity leads to the desired 
factor in the thermodynamic limit (TV —► oo). 

However, extensivity, in general, breaks down in small 
thermodynamic systems, and therefore the Pauli-Jaynes 
resolution cannot apply to them. Jaynes [3] Sec.9] ex¬ 
pressed his concern about this point by stating, “The 
Pauli correction was an important step in the direction 
of getting “the bulk of things” right pragmatically; but 
it ignores the small deviations from extensivity that are 
essential for treatment of some effects; and in any event 
it is not a fundamental theoretical principle. A truly 
general and quantitatively accurate definition of entropy 
must appeal to a deeper principle which is hardly rec¬ 
ognized in the current literature, [...]” Thus, we need 
a different guiding principle to determine /(TV) in small 
thermodynamic systems. 

Method. We use the fluctuation theorem ei mm 
as the guiding principle for small thermodynamic sys¬ 
tems. The fluctuation theorem, especially the Jarzynski 
equality (e~P( w - AF ' ) ) = 1 jT2], determines the equilib¬ 
rium free-energy difference A F between two configura¬ 
tions from statistics of work W in a nonequilibrium pro¬ 
cess. Unfortunately, the Jarzynski equality cannot apply 
to gas mixing because the initial state is not a global 
canonical equilibrium state of the entire box, which in¬ 
validates the prerequisite of the Jarzynski equality. 

We overcome this difficulty by applying the fluctua¬ 
tion theorem in the presence of absolute irreversibility 
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(a) original time reversaC 



FIG. 2. Time reversal and absolute irreversibility. The 
time-reversed process of gas mixing is the wall insertion for 
a global thermal equilibrium state, (a) Original and time- 
reversed processes of mixing of two identical gases. In the 
time-reversed process, the rightmost two events in which the 
state does not return to the original one have no counterparts 
in the forward process. Therefore, they are absolutely irre¬ 
versible. (b) Original and time-reversed processes of mixing of 
two different gases. The probability of absolutely irreversible 
events is larger due to the presence of the rightmost event 
which has no counterpart in (a). 

(i e -P (. w ~ AF )) = l — \ pj[| which allows an initial canon¬ 
ical state with spatial constraints. Here, the term A is 
the absolutely irreversible probability which is mathe¬ 
matically defined as the integral of the singular part of 
the time-reversed probability measure with respect to the 
forward probability measure [181 . For this singular part, 
the Crooks fluctuation theorem [13j is ill-defined because 
the dissipative work is divergent with singularly strong 
irreversibility. This is why the Jarzynski equality |12] 
should be modified in absolutely irreversible processes. 
We can calculate A as the sum of the probabilities of the 
time-reversed events whose corresponding forward events 
vanish. 

To demonstrate the existence of absolute irreversibility 
in gas mixing, we consider the time-reversed process of 
gas mixing, namely, wall insertion as illustrated in Fig. [5] 
The events indicated by blue arrows are absolutely irre¬ 
versible because they have no counterparts in the forward 
process. The absolutely irreversible probability A is given 
by the sum of the probabilities of these events. Thus, ab¬ 
solute irreversibility of gas mixing originates from fluctu¬ 
ations in the number of particles in each box after wall 
insertion and may be interpreted as an inevitable loss of 
information on the particle number in each box before 
gas mixing [25j . 

Main result. We now show that the validity of the 
fluctuation theorem with absolute irreversibility 

( e -nw- AFJ) = l _ A (4) 

for gas mixing in the isothermal environment is equiva¬ 
lent to the following choice of the ambiguity function: 

f(N) = Nf(l)-]nN\. (5) 

In particular, if the free-energy difference is calculated 


from Eq. Q, the thermodynamic entropy is defined and 
/(IV) is given by Eq. ([5|. Recall that, in the thermody¬ 
namic limit, the validity of extensivity ([ 2 ]) is equivalent 
to Eq. ®>- Thus, the fluctuation theorem with absolute 
irreversibility © in small thermodynamic systems takes 
the place of extensivity ([ 2 | in the thermodynamic limit. 
Note that Eq. © differs from Eq. © at the subleading 
order, namely in the mesoscopic regime. 

Proof. First, we assume Eq. 0 to derive Eq. 0 
We consider mixing of identical gases and that of differ¬ 
ent gases as illustrated in Fig. [2j and assume that gases 
are initially in thermal equilibrium with inverse temper¬ 
ature /3. We assume that the gas particles have the same 
mass and the interaction potential between two differ¬ 
ent particles is the same as that between two identical 
particles. Therefore the Hamiltonians for the two cases 
are identical. We also assume that the interactions do 
not break additivity. By the term additivity, we mean 
that the thermodynamic entropy of a system consisting 
of independent subsystems is equal to the sum of the en¬ 
tropies of the individual subsystems. The left (right) box 
is initially filled with an M (IV)-particle gas with volume 
Mv (Nv), and then the wall is removed. For identical 
and different gases, Eq. © gives (e -/3 ( Wid-AFid ))id = 
1 — Aid and (e -/3 ( Wdif-A ^ dif ))dif = 1 — Adif, respec¬ 
tively. Because no work is performed upon gas mixing, 
(e -/3Wid )id = (e -/3Wdif )dif = 1 holds. Therefore, we ob¬ 
tain AFi d - AF di f = ft B Tln[(l - A id )/(1 - A d if)]- Now, 
we evaluate the left-hand side of this equality. Since 
AF = A U — TAS and AFid = AFdif by the assump¬ 
tion of the same interaction potential, we obtain AFid — 
AFdif = —T(AFm — AFdif). Moreover, since the parti¬ 
tion functions for the two processes calculated by statis¬ 
tical mechanics based on “the specific phase” are equal, 
we have AFf^ at = AFgf. It follows then from Eq. © 
that the difference between the thermodynamic entropy 
productions can be evaluated only in terms of f(N) as 
AFid ~ AFdif = [A/id — A/dif]. For identical-gas mix¬ 
ing, the ambiguity function of the initial state is given by 
/id 1 = + /(A0 due to the assumption of additiv¬ 

ity, whereas that of the final state is = f(M + N), 
resulting in A/ id = f(M + N) — /(M) — /(IV). In con¬ 
trast, for different-gas mixing, we can quasi-statically 
connect the initial and final states by using a semi- 
permeable membrane. As a result, the entropy differ¬ 
ence is uniquely determined by the Clausius equality, and 
therefore the ambiguity function remains unchanged, and 
hence A/dif = 0. As a consequence, we obtain 

f(M + N) - f(M) - f{N) = lu^xrf- (6) 

This result implies that the ambiguity in the thermody¬ 
namic entropy represented by /(IV) is directly related 
to and hence can be removed by the degree of absolute 
irreversibility in the gas mixing process. 

To find A, let us consider the time-reversed process of 
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gas mixing, i.e., wall insertion as illustrated in Fig. [2] 
After the insertion, the state may or may not return to 
the original one. The events in which the state does not 
return to the original state are absolutely irreversible be¬ 
cause they have no counterparts in the forward process; 
the event in which the state returns to the original state 
is the only one without absolute irreversibility. There¬ 
fore, 1 — A is equal to the probability that the original 
state is restored after the wall insertion. Although this 
probability cannot be calculated explicitly in the presence 
of interactions, we can compare the probabilities for the 
two cases. The number of combinations for the M + N 
particles in which the left box contains M particles af¬ 
ter the wall insertion is equal to the binomial coefficient 
m+nCm '■= (Af + N)\/(M\N\). These partitions can be 
realized with equal probability due to the assumption of 
identical interactions. For identical gases, all of them are 
identified with the original state, whereas there is only 
one such state for different gases. Therefore, we obtain 
1 — A id = m+ n Cm (1 —Adif)- Then, equality 0 reduces to 
f(M + N) — f{M) — f(N) = — In m+nCm- The solution 
of this functional equation is given by Eq. (51). 

Next, we assume Eq. ([5]) to show Eq. (4|). We first 
consider identical-gas mixing. Let Z(N) denote the par¬ 
tition function of the gas with the particle number N 
and the volume Nv calculated by statistical mechan¬ 
ics based on “the specific phase.” Then, from Eq. 0, 
the thermodynamic free energy is evaluated as F(N) = 
-p-'\nZ(N)~ p- l f{N) = —/ 3 _1 ln[Z(N)(f(l)) N /N\}. 
Consequantly, the left-hand side of Eq. @ for identical- 
gas mixing reduces to (e _ ^ Wid_AFid l}id = e^ AFid = 
m+nCm • Z(M)Z{N)/Z(M + N). The right-hand side 
gives the probability to restore by the wall insertion the 
original state in which the number of particles in the left 
(right) partition is M(N). This is by definition equal to 
1 — Ay- Hence, Eq. © for identical-gas mixing is shown. 
A similar procedure vindicates Eq. 0 for different-gas 
mixing. Thus, the main result has been proven. 

Discussions. We have demonstrated that the validity 
of Eq. 0 is equivalent to that of Eq. ©. Therefore, 
mathematically speaking, requiring either of them pro¬ 
duces the same results. However, from a physical point 
of view, thermodynamics should have an operational ba¬ 
sis. In this sense, it is noteworthy that Eq. 0 defines 
the equilibrium free-energy difference from statistics of 
the work that we can operationally obtain by repeating 
a fixed nonequilibrium processes. Hence, we think that 
requiring Eq. 0 as the starting point is more appropri¬ 
ate for thermodynamics as an operational theory. 

As clarified in the context of GP-I m , the thermody¬ 
namic entropy depends on the operational capability of 
the beholder. Therefore, to deal with the thermodynamic 
entropy, we must define what we mean by the same and 
different states operationally. This is the conventional 
wisdom to resolve the Gibbs paradox. We do so by in¬ 
troducing different probabilities of absolute irreversibility 


for the two mixing processes because they are defined as 
the probability of time-reversed events that do not have 
the counterparts in the forward process. In this sense, 
we follow the conventional wisdom and claim no novelty 
on this point. Rather, we believe that any resolution of 
the Gibbs paradox is destined to follow it. 

As we have discussed above the fluctuation theo¬ 
rem with absolute irreversibility ([4]) is closely related 
to extensivity 0 . For simplicity, we consider mix¬ 
ing of identical ideal gases with the same tempera¬ 
ture and volume: (T,V,N\T,V,N) ->• (T,2V,2N). In 
the thermodynamic limit, we can explicitly show from 
Eq. Q that the thermodynamic entropy production 
upon gas mixing is sub-extensive, and such a sub- 
extensive correction is thermodynamically ignored, giv¬ 
ing S(T,V,N\T,V,N) = S{T,2V,2N). Therefore, as¬ 
suming additivity S(T, V, N\T, V, N) = S(T,V,N) + 
S(T, V, N) = 2S{T,V,N), we obtain S(T,2V,2N) = 
2 S(T,V,N), which is extensivity 0 with q = 2. Thus, 
Eq. 0 reduces to extensivity 0 in the thermodynamic 
limit. 

We have dealt with interacting gases by assuming that 
the interaction does not break additivity. In the Pauli- 
Jaynes method Ell, only noninteracting gases were dis¬ 
cussed. Although it is possible to extend their method to 
interacting gases such as van der Waals gases, a general 
discussion seems intractable because we have to invoke 
the specific form of the statistical-mechanical entropy. 
In contrast, our method can consider general interacting 
gases. We consider both identical- and different-gas mix¬ 
ing and compare their entropy production to cancel out 
the effects of interactions. We stress that to do so Eq. 0 
plays a crucial role. We translate the free-energy differ¬ 
ence A F, which is not explicitly computable, into the 
absolutely irreversible probability A, which is not either. 
However, AF^ — Afyjif is computable because the right- 
hand side of Eq. © can be evaluated by combinatorics. 
Thus, the fluctuation theorem with absolute irreversibil¬ 
ity 0 is crucial to remove the ambiguity f(N ) in the 
presence of interparticle interactions, although the fluc¬ 
tuations of work do not exist in gas mixing. 

One may wonder why we do not consider the ther¬ 
modynamic entropy of an open system from the begin¬ 
ning. We could extend the Clausius definition to an open 
system as AS = f s ( SQ + j. idN)/T. However, to de¬ 
fine the thermodynamic entropy in this way, we must 
define the chemical potential /i beforehand. The cru¬ 
cial point is that the chemical potential is defined from 
the very TV-dependence of the thermodynamic entropy as 
/ i , = TdS/dN. To avoid falling into a circular argument, 
we cannot start from an open thermodynamic system. 

Finally, we discuss why we consider isothermal systems 
instead of isolated systems. First of all, the original dis¬ 
cussion by Gibbs himself [2] considered the isothermal 
setup at a constant temperature. Furthermore, in small 
isolated systems, the relation between thermodynamics 
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and statistical mechanics is not completely understood. 
On the other hand, in isothermal systems, thermody¬ 
namic responses are considered to be reproduced by sta¬ 
tistical mechanics as long as the heat bath is infinitely 
large. Thus, GP-III is more well-defined in isothermal 
systems than in isolated systems. 

Conclusion. We have demonstrated that the validity 
of the fluctuation theorem with absolute irreversibility 
0 is equivalent to the specific form 0 of the ambiguity 
function of the thermodynamic entropy in Eq. 0. Re¬ 
quiring Eq. Q is more appropriate than requiring Eq. ([5]) 
from an operational point of view. 
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